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ABSTRACT 


There is no doubt that car parking is a very challenging and interesting topic 
of surveillance. In the recent years, a lot of smart systems for parking lot 
access control were developed to control and register the car data. The aim of 
this paper is to use image processing methods to control the entrance of a 
smart parking. The steps of car plate recognition are: preprocessing, License 
plate detection, character extraction and recognition. In the step of 
preprocessing, image was enhanced and _ noise’ was_ reduced. 
After preprocessing stage, color filter was used to detect the plate region. 
In case of large image size DWT was used for feature extraction and 
decreased the time of the detection stage. In the stage of character 
segmentation, the image is converted from grayscale to binary according to a 
given threshold. Filtering the binary image after using the morphological 


Recognition operation method, the largest objects are determined as the segmented plate 
Segmentation characters. Finally, the correlation method was used to recognize the 
Smart parking segmented characters. In case of similarity, SVM was used as a good 
classifier. Experimental results using matlab software, view that the proposed 
method increase the plate detection and recognition rates. It achieved average 
97.8% detection rate, 98% segmentation rate and 97% recognition rate, so it 

will be a good method for smart parking entrance control. 
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1, INTRODUCTION 

The industrialization of the world, slow paced city development, and increase in number of cars has 
resulted in parking problems. There is a need for a robust system to be used for searching the free parking 
lots. Smart Parking System (SPS), is considered to be a small version of an Intelligent Transportation 
Systems (ITS) [1]. This SPS using Internet of Things (oT), to reduce the parking congestion. 

In [2] authors introduced a method for parking guiding system and space analyzing. [OT begin with 
things which have independent connected devices. These devices should be monitored, or under controlled 
using connected computers [3]-[4]. We have created a smart parking guidance algorithm in [5] depending on 
a cost function. In order to identify the cars, image processing techniques also was introduced. To detect the 
illegal (unreserved) cars, they used Optical character recognition (OCR) method. OCR is used to convert the 
row text and documents (like text books) into electronic readable les like (pdf). In [6] a hybrid feature 
extraction method was introduced for facial recognition and gave average recognition rate 100%. 

An automatic car parking system using FPGA based on emergency conditions was proposed to 
detect the drivers condition and perform specific tasks such as warn the drivers [7]. We want to use image 
processing techniques in order to control the parking entrance. In order to solve the problem of parking 
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entrance management, a lot of research was made. Automatic License Plate Detection(ALPD) is to 
automatically detect the license region from a given image. 

In [8] an ALPD method consist of five steps was introduced for handling different hazardous rates. 
The previous ALPD was developed and tested on database consists of 850 images in different controlled 
conditions like night, indoor, blurry, day, rainy, foggy and tilted LP. This method achieve global 94% 
detection rate, but it can be enhanced by using a lot of filtering methods. 

In [9] a new method presented to apply the LPR systems for Iranian license plates. Increasing the 
accuracy of the character recognition phase rate and decreasing the training rate are the main advantages of 
the new hybrid model. The K-NN was implemented as the first classification method; the confusion problem 
related to similar characters in the license plates was overcome by using the multiple SVMs classification 
model. The SVMs has improved the performance of the K-NN in the recognition of similar characters. 
The SVMs was trained and tested only for the similar characters. The proposed method gave 97% character 
recognition rate. 


2. RESEARCH METHODS 
2.1. Morphological Operation 

Morphological of image preprocessing is a sequence of non-linear operations depending on the 
morphology or shape of the features. Morphological operation does not depend on the numerical values, 
but depends on the related ordering of the pixel values and so are especially effective to the preprocessing of 
binary images. We want to thin connectivities between large white areas extended outer region of given 
images and remove small thin white objects. Due to the previous needs, morphological operation [10] 
(erosion, then dilation) is applied on a given binary image f. In the erosion step: erosion image f by 
structuring element s output a new image g having values one in all pixels (x; y) of a structuring element's 
when s fits f. In the dilation step: dilation of a binary image f by a structuring element s output a new image g 
having values one in all pixels (x; y) of a structuring element's when s hits f. Figure 1 show an example of 
hitting and fitting a binary image. 


000000000000 
B.... 0007100000100 
001111100000 
0111111110000 
011111110000 
0047111110000 
004111111000 
004111111110 
A000001111110 
000000000000 





Figure 1. Example of hitting and fitting a binary image 


2.2. Discrete Wavelet Transform 

Wavelet transforms are mathematical functions used to convert data into a lot of frequency 
components and each component is studied with a resolution corresponding to its scale. Wavelets were 
presented independently in the field of mathematics [11], electrical engineering and quantum physics. In the 
last decades, many new wavelet applications were appeared like image compression, prediction of 
earthquakes, turbulence, radar and human vision. The mother wavelet decomposition function for an image is 
defined as: 


. (ux+vy) 


Put) = Lrao Uyzo f(x, y)exp ’” (1) 





Where, 


— 1 (ux+vy) . . . . . . 
exp 7” WN isa Kernel function, f(x,y) is a2Dimage, and N is count of pixels. 


The Wavelet transform is a useful computational tool for applications of signal and image 
processing [12]. DWT is used in a wide range in pattern recognition area [13], [14]. 
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Figure 2 view an example of DWT one level decomposition. LL1 describes approximate 


information, LH1 describes Horizontal information, HL1 describes vertical edge information, and finally the 


diagonal information is presented by HH1. 
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Figure 2. DWT coefficients 
3. PROPOSED METHOD 
This paper presents a hybrid framework for robust license plate detection and recognition system. 


License Plate Detection 
(Compute Rate) 


Character Segmentation 
(Compute Rate ) 


Figure 3 view the general steps of ALPR system. 
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Figure 3. General steps of ALPR system 


3.1. Image Acquisition 
Figure 4 show how to get the car image. A digital camera is installed in the entrance of the parking, 
to collect the car image. Once the image is captured, we directly go to the next step (Plate Detection). 





Figure 4. Image acquisition 
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3.2. Plate Detection 

Plate area extraction or detection is the most important step because the license plate is in a small 
region and may be anywhere in the given image. It can be defined by its features. The proposed detection 
method depends on the License Plate color. The goal of the detection step is to mark an area with highest 
probability of having the plate. The detection method depends on two License Colors(White and Yellow 
backgrounds). The given RGB Image is converted to index image using rgb2ind() function, then use two 
color filter. White range is (R > 0:5; G > 0:3; B > 0:81) and Yellow range is (R > 0:3; G > 0:3; B < 0:31). 
Now we shall remove the noise objects using bwareaopen() function to remove objects smaller than 200. 
Using the morphological operation for both erosion and dilation. Remove objects smaller than 3500 pixel, 
then the area with the biggest size 1s determined as the plate area. Figure 5 view example of detected plates 
with two colors yellow and white backgrounds. 

The detected area is converted from rgb to gray to be used in the stage of character segmentation 
due to the following (2). 


Y = 0.2989 « R + 0.5870 *G + 0.1140 « B (2) 
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Figure 5. Detected plates 


In case of white or yellow foreground car, the areas with the smallest size are extracted. the detected 
areas are not considered to be the correct plate unless the segmentation stage is applied. 

In this case, the segmentation stage is used to classify the detected areas. The area that contains 
characters 1s considered as the correct plate area. Figure 6 view example of detected plates with two colors 
yellow and white. 
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Figure 6. Detected plates in yellow and white foreground 


Parking entrance control using license plate detection and recognition (Mohamed S. Farag) 


480 O ISSN: 2502-4752 


3.3. Character Segmentation 

In this stage we have the extracted gray plate and want to segment the characters. Figure 8 view the 
Steps of the Segmentation stage. The given plate image is converted from grayscale to BW (black and white), 
based on a threshold corresponding to the following. 


= if xij > 6, 
= 0 Othewise. 
Using two filters steps: 
a. Remove the smallest objects in the binary image, and leave the largest 6 objects. 
b. | Remove objects which are not in the same vertical range. 


Figure 7 view object to be removed, because it is not in the same vertical range. Finally, the 
segmented character is assigned to the final step (Character Recognition). 





Figure 7. Removed objects 


The following algorithm is a pseudo code defines how to remove objects, which are not characters. 
Algorithm 1: Pseudo Code for Removing non Characters 


Require: Objects, Obj_num, Obj_rowrange 
Ensure: New Objects 

1: for i=1 : Obj_num do 

2:Get Objects i height andwidth 

3:if Objects i_width >Objects i_heightthen 
4:if Objects i_rowrange! =Obj_rowrangethen 
5:Remove Objects_i from NewObjects 
6:endif 

7:endif 

8: endfor 
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Figure 8. Segmentation process 
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3.4. Character Recognition 
In this step, we have the segmented characters and want to recognize it. The following (3) was used 
for computing correlation rate between two images A and B. 


Yi Xj (Aij-A) (Bij-B) 


(3) 





(Xi Lj (Aij—-4) 7 #25 Uj (Bij-B)) 


Where both A and B are the mean of A and B respectively. In case of similarity, which cannot be 
recognized using the correlation method. For example (D, O and 0), (B and 8) and (2 and z), in this case 
further training is needed. The way is to use Support vector machine (SVM), which is defined as a learning 
method used for data classification. SVM considered as a statistical classification algorithm and was 
proposed by Cortes and Vapnik [15]. SVM becomes popular because it gave high rate in handwritten digit 
classification. SVM was used for image classification in [16]. This algorithm search for the maximum 
separating hyperplane, which is defined by the hyperplane with the maximum distance between the 
training tuples. 


4. RESULTS AND DISCUSSION 

In this experiment, we test the accuracy and efficiency of the system. The white color plates images 
are taken from AOLP database [17] cited in paper [18]. The yellow color plates are collected from the 
internet. The car images database has different conditions, like brightness, different font size, shadow, 
low contrast, different car colors, different font type and different images size. Table 1 view the experimental 
results of the detection step. In case of white background the correct detection rate was 97.4%, and in case of 
Yellow plate the correct rate was 97.8%. 


Table 1. Experimental Plate Detection Result 


LP Type Number of Images Success Number Success Rate — Average Image Size(Pixel) 
White-Black 117 114 97.4 640*480 
Yellow-Black 46 45 97.8 1024*768 
Total 163 159 97.5 


Table 2 show the comparison between the proposed detection method and other reported papers. 
The reported papers used the same database, and we add the database of yellow color plates. It is clear that 
the proposed method outperform the reported method in both correct detection rate and execution time per 
each image. 


Table 2. Comparison with the Reported Articles 


No Reference Correct Average Execution System Specification 
Rate Time(Sec.) 
1 Azam et al [19] 86.15 0.45 C: Intel Core 2 Duo, 2.2 GHz 
S: 120X40 (non-tilted), 80X55 (tilted) 
2  Ghahnavieh et al [20] 95.5 0.0968 C: Core 2 Quad, 2.67 GHz S: 
640X480 to 2000X1500 
3 Tadic et al [21] 94.4 - - 
4 Panahi et al [22] 96.3 0.18 C: Intel Core 15, 2.2 GHz S: 16X80 
to 25X1508 
5 Proposed Method ees) 0.123 C: Intel Core 13, 2.4 GHz S: 


640*480 to 1024*768 


In case of large image size (for example: 2000 * 1950 pixel), DWT was used before detection stage. 
DWT generate 4 coefficients (approximation, horizontal, vertical, diagonal). The approximation coefficient 
was used as the test image, then the detection step was applied. Using DWT decrease the time of the 
detection stage from 0.4892 seconds to 0.167, approximately 67% decrease time rate. 

Applying character segmentation stage on the detected plates, the experimental result gave 98% 
correct segmentation rate. 

For recognition, pattern with maximum correlation is used as the recognized pattern. In case of 
similarity, the MultiSvmTrain() function was used to models a given training set with a corresponding group 
vector and classifies a given test set using MultiSvmClassifyQ function according to a one versus all relation. 
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Each character in training set has 3 images. The different Kernel functions test results showed that the best 
SVMs function for this study is the Gaussian Radial Basis Function (RBF). The RBF kernel is defined as: 


Kepr(x,x') = exp[-y Il x — x’ [I7] (4) 


where is a scaling parameter that sets the spread of the kernel and its default value is 1. 
The characters which were considered as similar characters (0, D, O), (B, 6, 8), (S, 5) and (2, Z), SVM was 
used to buildthe model for each group. If the correlation method gave any characters of them, 
the MultiSvmClassifyQ) will used to classify the given characters using its group model. SVM gave average 
97% recognition rate, unlike the correlation method gave 94% correct recognition rate. 


5. CONCLUSION 

In this paper we present a hybrid method to improve on the current techniques of car plate detection 
and recognition. The proposed method detects the plate number in two _ background color 
(White and Yellow). The detection rate was increased to 97.8%. In case of big image size the DWT was used 
in the preprocessing stage, which decreased the time consumed in detection stage with 67%. In the 
segmentation stage, plate converted from grayscale to black and white. A defined filter was used to remove 
objects which are not characters. Objects are not in the same row range, or the width is larger than height. 
Finally the correlation method was used to recognize the segmented characters. If the character is defined to 
be (D, 0, O, B, 8, Z, 2 ...) which has similarity, in this case SVM used for classification. SVM gave 97% 
recognition rate and correlation method gave 94% recognition rate, which means that using SVM is 
essentially for increasing recognition rate. 
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